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(57) Abstract: A mobile telephone (10, 
20) receives, constructs and displays an 
image (32) from a server (18) over a mobile 
telephone network (12, 16, 18) where the 
server (18) determines the parameters for 
data transfer from the server (18) to the 
mobile telephone (10, 20), the capabilities 
of the mobile telephone (32) transfer task 
requirements, and appportions the processing 
between the server and the mobile telephone 
(10, 20) for each of a plurality of elements 
(28, 30, 38, 40, 42, 44, 46, 48, 50, 52, 54, 
60, 62) in each image (32), thereby to meet 
the task requirement, which can include 
being within a predetermined time for task 
completion, or being the fastest means for 
task completion. Parameters for data transfer 
from server (18) to telephone (10, 20) 
include server (18) transmission bandwidth, 
phone (10, 20) reception bandwidth, data 
channel bandwidth, transmission protocol; 
and channel accessibility. Phone (10, 20) 
capabilities include the data processing 
speed, the available memory, display size 
and the data processing software available; 
Task requirements include the maximum 
time from transmission to display of the 
image; and the minimum display resolution 
of the image. 
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Efficient: Image Transmission 



5 The present invention relates to transmission of displayable images 
from a source to a receiver. The invention particularly relates to 
such transmission where resources, such as bandwidth, time or 
processing power can be limited. The invention, most particularly, 
relates to the transmission of images which are constructed, or re- 
10 constructed, at the receiver. 

Increased sophistication of, in particular, mobile telephone 
systems, has created a demand for ever improved images which tax 
the ability of the network to carry them and the processing 

15 capacity of the receiving device to display them to the required or 
desired resolution within the available time. The very same problem 
arises in the field of computer games and in the provision of 
Internet images. Carriage capacity depends upon instantly 
available bandwidth, the abilities and processing speed and 

20 capacity of the receiver, the desirable maximum tine limit within 
which the image should be displayed and the desirable minimum 
resolution in the image. 

As demand increases, so the instantly available bandwidth can find 
25 itself altered as more subscribers seek access to a limited 

resource. The present invention seeks to provide an ameliorating 
solution, capable of coping with such alteration, both in the short 
term and in the long term. 

30 Different types of receiver have different reception and processing 
capacities. The present invention seeks to provide a system, method 
and apparatus capable of accommodating a wide variety of different 
receivers from a single transmission source. 

35 Many different types of material and images can be provided for 
transmission. Some material, because of its size or nature, can 
overwhelm the capacity of the system to provide an adequate 
transmission service. The present invention seeks to provide a 
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system, method and apparatus capable of adapting to different 
material to allow its adequate transmission under a wide range of 
conditions . 

5 The world does not entirely revolve around the act of image 

transmission and display. The receiving apparatus is required to do 
other things, such as computation and communication, to name but 
two. It is very much to the advantage of the system that the act of 
image transmission and display should not encroach upon the other 
10 activities of the receiving device. The present invention seeks to 
provide a system, method and apparatus capable of minimising the 
impact of image transmission and display upon the receiving 
apparatus, thereby freeing the receiving apparatus for other 
operations . 

15 

According to a first aspect, the present invention consists in a 
method for sending a processed image, comprising one or more 
elements, from a server to a client for display, said method 
comprising the steps of: determining the parameters for data 
20 transfer from the server to the client; determining the 

capabilities of the client; determining the task requirements; and 
apportioning the processing between the server and the client for 
each element to meet the task requirement. 

25 The invention further provides that the parameters for data 

transfer from the server to the client can include one, all or some 
of the server transmission bandwidth, the client reception 
bandwidth, the data channel bandwidth, the transmission protocol 
and channel accessibility. 

30 

The invention further provides that the capabilities of the client 
can include one, all or some of the data processing speed of the 
client, the available memory of the client, the size of display in 
the client, and the data processing software available within the 
35 client. 
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The invention further provides that the task requirements can 
comprise one, all or some of the maximum time from transmission to 
display of the image, and the minimum display resolution of the 
image . 

5 

The invention further provides that each element be constructed for 
display using a selectable one of a plurality of processing 
options, and that the method can comprise the step of selecting an 
option that meets the task requirements. 

10 

The invention further provides that selection of the processing 
option can include measuring or calculating the time to execute of 
some or all of the plurality of options. 

15 The invention further provides that the construction of an element 
can comprise one, all or some of: clothing a coarse mesh with a 
simple texture, clothing a fine mesh with a simple texture, 
clothing a coarse mesh with a complex texture, clothing a fine mesh 
with a complex texture, clothing a surface with a complex texture, 

20 clothing a surface with a simple texture, and clothing a surface 
with a three dimensional panel. 

The invention further provides that the apportioning of the 
processing between the server and the client can include allocating 
25 the location for each action in the construction of an element. 

The invention further provides that the determining of the 
capabilities of the client can include interrogation of the client 
by the server. 

30 

The invention further provides that interrogation of the client can 
include the client informing the server of its abilities. 

The invention further provides that determining the capabilities of 
35 the client can include reference, by the server, to a list of 
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client characteristics for a plurality of different types of 
client . 

The invention further provides that meeting task requirements can 
5 include falling within the minimum time to execute, or being the 
fastest to execute. 

The invention further provides that the server can be a server in a 
mobile telephone system and that the client can be a mobile 
10 telephone device. 

According to further aspects, the invention includes a system, a 
server and a client, each adapted to use the above described 
method . 

15 

The invention is further explained, by way of example, by the 
following description taken in conjunction with the appended 
drawings in which: 

20 Fig 1 is a schematic diagram of the environment in which the 
present invention has its exemplary embodiment. 

Fig 2 is an illustrative diagram of a first method, employable 
within the present invention, of creating a three-dimensional image 
25 using a coarse mesh and a detailed skin. 

Fig 3 is a schematic diagram of a method, employable within the 
present invention, whereby a complex three-dimensional panel can be 
created using a combination of different wire meshes and textures. 

30 

Fig 4 illustrates how, within the invention, a scene, in this 
example the interior of a room, can be created using different 
panels and textures. 
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Fig 5 is a flow chart illustrating a manner in which a transmitting 
apparatus can send an image to a receiving apparatus. 

Fig 6 is a flow chart illustrating how a transmitting apparatus can 
5 identify the nature of a receiving apparatus. 

Fig 7 is a flow chart illustrating how a transmitting apparatus can 
arrive at an acceptably adequate solution for transmitting an image 
to a receiving apparatus. 

10 

And 

Fig 8 is a flow chart illustrating how a sending apparatus can 
optimise the transmission of an image to a receiving apparatus. 

15 

Attention is drawn to Fig 1 showing the environment in which the 
preferred embodiment of the present invention exists . 

A mobile telephone 10 is part of a communications system. The 
20 mobile telephone 10 communicates with a base station 12 which, in 
turn , is connected by wires, cables, microwave link or satellite 
to the terrestrial telephone network 14 which provides 
communication via further base stations 16 and servers 18. The 
further base stations 16 permit communication with further mobile 
25 telephones 20. The mobile telephone 10 comprises a screen 22 

whereon images can be displayed. The terrestrial telephone network 
14 can, via the Internet or by direct file transfer, act as the 
conveyance for images to be displayed on fixed 24 or portable 26 
computer equipment and on the screens 22 of mobile telephones 10, 
30 20. 

The present invention is concerned with the ability of a fixed 
resource such as a computer 26, 24 or a server 18 to send an image 
to the screen 22 of a mobile telephone 10, 20. 

35 
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Although the invention is hereinafter described with reference to 
displaying images on the screen 22 of a mobile telephone 10, 20, it 
is to be understood that the present invention also applies to any 
environment where an image must be sent to and displayed on a 
5 screen 22 or a receiving apparatus where resources may be limited. 
Such situations include direct file transfer between computers, 
television, and the Internet. This list is not exclusive. 

Attention is drawn to Fig 2, which is a diagram illustrating one 
10 method that the present invention can use for transferring an image 
from a sending device to a receiving device. As will become clear 
from the description of the present invention, the present 
invention may use a range of techniques to match the properties of 
the data transmission channel and the receiver to allow an image to 
15 be sent to a receiver at an acceptable quality in an acceptable 

time, without overwhelming the receiver's processing ability. Fig 
2 illustrates a first technique which can be employed. 

A first action is for the transmission device to send a coarse mesh 
20 28 to the receiving device. In the example chosen, a three 

dimensional image of a camera is to be sent. The coarse mesh 28 
comprises a series of straight lines which define the surface of 
the object. In the simple coarse mesh 28 shown in figure 2, the 
wire frame model can be sent, typically, as a group of data 
25 comprising in the region of five kilobytes. 

In order to overcome the simplicity of the coarse mesh 28, the next 
element to be sent is a complex texture 30. A texture is a 
detailed two-dimensional skin bearing images of the surface of the 
30 object. Because the coarse mesh 28 is so simple, in order to make 
an acceptably detailed-looking end result, a complex texture 30 is 
necessary. In this example, a typical complex texture 30 can be 
sent in a data package comprising in the region of five hundred 
kilobytes . 



35 
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In order to create the assembled image 32, the complex texture 30 
is, in the receiving apparatus, laid or stretched like a skin 
around the coarse mesh 28. A complete three-dimensional 
representation 32 of the exemplary camera is thus created and can 
5 be viewed from all angles as a complete 3D object. The complex 
texture 30, in this example, covers the entire surface of the 
coarse mesh 28. 

As will become plain from the following description, a texture can 
10 be provided to cover a fractional part of a defining surface. 

Depending upon the circumstances, the sending device can adopt 
different tactics. Unable to be illustrated in this patent 
application because of the restrictions on the nature of acceptable 

15 drawings imposed by the United Kingdom Patent Office, the sending 
device may use a complex mesh (a wire frame with great detail) in 
combination with one or more simple textures to achieve a similar 
acceptable three-dimensional image result. A complex wire frame 
surface-defining model may, within the present invention, comprise 

20 data of around twenty kilobytes. One or more simple textures, in 
the case of a representation of a radio, defining knobs, stickers, 
tuning scales etc, can be accommodated within five kilobytes. 
Within the present invention, therefore, a three-dimensional image 
of a radio can, if required, be transmitted from a sending 

25 apparatus to a receiving apparatus in approximately twenty 
kilobytes of data. 

Another technique which can be used by the present invention, but 
which, equally, is nearly impossible to illustrate within the 
30 drawing restrictions of the United Kingdom Patent Office, uses 

texturing to overlay extremely complex images onto plain or simply 
shaped surfaces. Such a technique can be used, for example, when 
sending three dimensional images of the interior of the Sistine 
Chapel. 



35 
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Attention is drawn to Fig 3, showing another technique available 
within the present invention. 

In Fig 3 the left hand box 34 represents the activity of the 
5 transmitting device, generally known in the art as a server. Again 
in Fig 3, the right hand box 36 shows the activity of the receiving 
device, generally known in the art as a client. Fig 3 shows one 
way in which the transmitting device or server can distribute the 
various activities required in the transmission and the display of 
10 an image, to optimal effect, between the server 34 and the client 
36 to accommodate the limitations of the channel bandwidth and 
client processing capabilities. 

Fig 3 shows how secondary modelling can be used to create textures 
15 which are then applicable to meshes (wire frame models) to create 
complex 3D objects or, as will be shown in relation to Fig 4, 
panels which can be applied to defining surfaces. 

In the example given in Fig 3, the first action of the server 34 is 

20 to create a complex texture, but this time employing the client 36 
to do the processing. As a first step, the server 34 sends, to the 
client 36, a texturing frame 38. This particular texturing frame 
38 can, typically, comprise no more than ten kilobytes of data, 
despite its fairly complex detail. The purpose of the texturing 

25 frame 38 is to provide sufficient surfaces and surface detail to 
create a texture, as was previously shown as item 30 in Fig 2. 
Along with the texturing frame 38 the server 34 also sends one or 
more simple textures 40, 42. The textures 40, 42 are then applied, 
by the client 36 to the texturing frame 38. The textures 40, 42 

30 can, typically, in an example such as this, comprise no more than 
around five kilobytes of data. The simple textures 40, 42 are 
applied, by the client 36, to the texturing frame 38, to create a 
complex texture 44. As well as simply applying the simple textures 
40, 42 to the texturing frame 38, the client 36 can also be 

35 instructed to apply lighting and shading operations to cause the 
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complex texture 44 to have an immense richness of detail. Thus, by 
a few simple instructions, wire frames and textures, a richly 
endowed complex texture 44 can be created. The complex texture 44 
does, of course, reduce to an effective flat surface. That is to 
5 say that the three-dimensional detail of the texturing frame 38 is 
reduced to the two-dimensional surface of the complex texture 44. 
As will be seen, three-dimensional detail is restored. 

As a second activity, the server 34 transmits, to the client 36, a 

10 simple frame outline 46. In the example given, the simple frame 
outline 4 6 can comprise as little as two kilobytes of data. The 
client 36 wraps the complex texture 44 onto the wire frame outline 
46 to create a complex panel 48. The frame outline 46 restores the 
three-dimensional quality of the complex texture 44. Equally, if 

15 so desired, although requiring more complex processing on the part 
of the client 36, some or all of the three-dimensional detailing of 
the texturing frame 38 can be retained so that the complex texture 
44 has at least a partial three-dimensional quality which can be 
added to the frame outline 4 6 to create yet extra three-dimensional 

20 detail. Although the end result, in this example, is a complex 
panel 48, where only one side needs to be visible, there is 
nothing, within the present invention, to stop the server 34 and 
the client 36 co-operating to create images such as the camera of 
Fig 2. The server 34 would choose a technique, such as that shown 

25 in Fig 3, where the client 36 has sufficient processing capacity of 
sufficient speed to create the complex panel 48 picture element 
within an acceptable time. In other circumstances the server 34, 
if the band width of the communications channel were sufficiently 
large, and the processing capacity of the client 36 sufficiently 

30 minuscule, might send a complete photographic image of the complex 
panel 48 if that is all that it could do within the allotted time. 
As will become plain, the essence of the present invention is 
flexibility and adaptability to permit image transmission, in 
acceptable time, over all sorts of data channels and using all 

35 manner of equipment. 
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Attention is drawn to Fig 4A and to Fig 4B showing another example 
of the present invention causing a server 34 to co-operate with a 
client 36 to create a final image. Fig 4A shows a room 50 as 
5 defined by a simple cuboid surface, one corner of which is visible 
in this view. 

Fig 4B shows how the present invention can be used to create an 
image of the room 50 , in this example a fanciful interior of a tomb 
10 or temple from an unspecified ancient civilisation. 

The floor 52 and ceiling 54 of the room 50, in this example, are 
covered by respective first 56 and second 58 textures with a 
substantially flat surface. The side walls 60, in this example, 

15 are covered by complex three-dimensional panels 62, which could be 
created by similar techniques to those shown in Fig 3. Just by way 
of contrast, the end walls 64 are covered in complex texture panels 
66 which can be created in a manner similar to the complex texture 
44 of Fig 3 or may be simply transmitted as the complex texture 30 

20 of Fig 2, dependent upon the capacity of the data channel and the 
processing capacity of the client 36. 

So far, the present invention has been described with reference to 
techniques which can be elected for the transmission and display of 
25 an image. The description now passes to explanation of the manner 
in which the present invention can elect which methods to employ 
from among those already described. 

Attention is drawn to Fig 5 showing a flow chart of the manner in 
30 which the server 34 can prepare and send an image or scene to a 
client 36. 

From start 68 a first test 70 checks to see if the server 34 
already has the scene analysed. This is the probable condition 
35 since the server 34 will, most probably, be providing the client 36 
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with stock material such as a movie, cartoon, advert or other 
screen also provided to many other clients 36 on demand, and 
provided to the server, from an outside supplier, in a (hopefully) 
pre-analysed form. If, however, the scene has not already been 
5 analysed into elements, each suitable for separate transmission, a 
first operation 72 analyses the scene into such items as may be 
sent. These items or elements are stored. Control then passes to 
a second operation 74. If the first test 70 detected that the 
scene was already analysed, a third operation 76 consults the 
10 element memory and also passes control to the second operation 74. 

The stored analysed scene can be stored in many ways. Each 
element, such as the complex panel 48 of Fig 3, can be derived 
using different recipes. At one extreme, a complete three- 
15 dimensional bit map can be provided. Other techniques include 

those shown in Fig 2 and in Fig 3, as well as those others alluded 
to but incapable of being illustrated under the present regime. 
So, when reference is made to an element, that element includes a 
plurality of possible recipes for its creation and display. 

20 

Returning to Fig 5, the fourth operation 74 gets the first element 
of the scene from the element memory. A fourth operation 78 then 
gets the parameters, from the client 36, of the receiver (client) . 
The parameters include such items as the bandwidth of the 

25 connecting data channel, the memory capacity of the receiver, the 
processing clock speed of the receiver, the processing type or 
style of the receiver, the display type, and any other factors 
which will affect the manner in which an image of a scene can be 
sent to the client 36. In general terms, all that is necessary is 

30 for the receiver type to be indicated by an identifier so that the 
server 34 can recover the receiver parameters from a memory. If 
this is not the case, the receiver must be interrogated to discover 
the necessary data. 



WO 03/061273 



PCT/GB03/00118 



12 

Having discovered the potentials and limitations of the 
communications system and the client 36, a fifth operation 80 has 
the server 34 seeking the fastest way to get the picture element 
into the receiver (client 36) . If the client 36 is of a type 
5 already known, the server 34 need only look up pre-stored values to 
know what to do. If any feature of the client system 36 is 
unknown, the server 34 either calculates, or tests by doing, the 
amount of time required to transfer an element or group of elements 
to the client 36. Where a number of elements are concerned, every 
10 possible combination will be considered in case there is a solution 
which turns out to be faster than the others. Once a viable 
solution has been found, it is stored to be retrieved when required 
in the future. 

15 Having found the fastest or an acceptably fast way to get an 
element into the client 36, a sixth operation 82 creates the 
fastest routine in the form of data and instructions to be sent to 
the client 36. A seventh operation 84 then adds the fastest 
routine to a fastest routine list which collects together the 

20 various versions of the elements to be transmitted to create the 
final entire scene. A second test 86 checks to see if the last 
element of the scene has been added to the fastest routine list. 
If not, an eighth operation 88 retrieves the next elements from the 
element memory and passes control back to the fifth operation 80 

25 for further elements to be prepared for transmission. 

If the second test 86 detects that the last element of the scene 
has been prepared for transmission, a ninth operation 90 sends the 
prepared group of fastest routines to the receiver (client 36) via 
30 the data channel, together with any instructions. A third test 92 
then checks to see if the group of fastest routines for that 
particular scene has already been stored. If it has, control 
passes to exit 94. If not, a tenth operation 96 stores the group 
of fastest routines for that particular client 36 or style of 
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client so that they may be retrieved for instant use on any future oc 

Attention is drawn to Fig 6, a flow chart showing how the server 34 
interacts with the client 36 (receiver) to determine the manner in 
5 which to send an image of a scene to the client 36. Fig 6 
corresponds to the fourth operation 78 of Fig 5. 

From entry 98 a fourth test 100 checks to see if the receiver and 
its associated data channel is of a known type. If it is, an 

10 eleventh operation 102 recalls the known parameters from a type 

memory and exits the routine at exit 104. If the fourth test 100 
detects that the receiver and its data channel is of an unknown 
type, a twelfth operation 106 has the server 34 call the client 36 
(receiver) and interrogate it to get the necessary details. A 

15 thirteenth operation 108 determines the limiting bandwidth of the 
data channel and/or of the receiver. A fourteenth operation 110 
has the server 34 being informed of the processing type and speed 
of the receiver. A fifteenth operation 112 has the server 34 
informed of the memory capacity of the client 36. A sixteenth 

20 operation 114 has the server 34 informed of the types of program or 
image display/ processing/reconstruction programs or software 
contained within the client 36. A seventeenth operation 116 has 
the server 34 informed of the type identifier of the receiver 
(client 36) . An eighteenth operation 118 then has the server 34 

25 store the client 36 (receiver) parameters so that they can be 
instantly retrieved when next that or a similar receiver is 
encountered . 

Attention is drawn to Fig 7, a flow chart illustrating one way in 
30 which the server 34 can execute the fifth operation 80 of Fig 5 
where the fastest way to get an element of the scene into the 
receiver or server 36 is found. 

From entry 120 a nineteenth operation 122 retrieves the available 
35 resources from the element memories that are associated with the 
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particular selected element. These can include such items as 
complete three-dimensional bitmaps, wire frames, textures, texture 
frames and any other part which can be used, and happens to be 
available, for creating the selected element of the image. Thus, 
5 the server 34 has awareness of the parts which it has to hand to 
create the selected element of the scene. 

A twentieth operation 124 then either receives, or retrieves from 
store, the task requirements. Task requirements can include, but 
10 are not limited to, maximum time for execution, minimum resolution 
on the image on the screen 22, and so on. 

Having determined what resources and minimum requirements exist, a 
twenty-first operation 126 puts together the first possible group 

15 of resources capable of sending the selected picture element to and 
displaying the selected picture element at the client 36. A 
twenty-second operation 128 then tests the time to execute the 
transmission and display of the selected picture element. As 
earlier described, this can be done by numerical calculation, by 

20 adopting the same memory capacity, processing software and 

processing style as the client 36 and actually measuring how long 
was taken to execute, or by a combination of the two methods. 

Having tested the time of execution in the twenty-second operation 
25 128, a fifth test 130 checks to see if the execution time falls 
within the task requirements set out in the twentieth operation 
124. If that method falls within the task requirements, a twenty- 
third operation 132 elects that method to be used and the routine 
proceeds to exit 134. 

30 

If the fifth test 130 determines that the particular set of 
possible resources has not fallen within the task requirements as 
defined by the twentieth operation 124, a twenty-fourth operation 
136 gets the next set of possible resources capable of transmitting 
35 and displaying the selected element of the image, and returns 
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control to the twenty-second operation 128 where the time to 
execute is measured. 

If, after testing the time to execute of all possible sets of 
5 resources, no set has been found which falls within the task 

requirements, the server 34 can select the set of resources which 
takes the least time, or alternatively, can signal to the client 36 
(receiver) that task requirements cannot be met. 

10 Finally, attention is drawn to Fig 8, a flow chart showing 

essentially the same function as Fig 7, but where the fastest 
rather than the first acceptable routine within the task 
requirements is selected. Fig 7 can be used where there is a 
pressing urgency to provide an image to a client 36 of unknown 

15 type. Fig 8 can be used, at leisure, where the server 34 can find 
the fastest way to provide an image of a scene to a client 36. 
Like numbers denote like elements. All elements are the same, as 
in Fig 7, until what would have been the fifth test 130 which is 
replaced by a sixth test 138 which looks to see if the execution 

20 time discovered on the twenty-second operation 128 is less than a 
stored value. If it is not, that particular set of possible 
resources is simply discarded, a seventh test 140 checks to see if 
it is the last possible combination, and the twenty-fourth 
operation 136 gets the next set of possible resources for the 

25 twenty-second operation 128 if it is not. 

If the sixth test detects that the execution time is less than the 
stored value, a twenty-fifth operation 142 discards the old stored 
value and method and, in its place, stores the currently tested set 
30 of possible resources and the execution time. The twenty-fifth 
operation 142 therefore keeps a running records of what has, so 
far, been found to be the fastest method. When the seventh test 
140 detects that the last combination has been detected, a twenty- 
sixth operation 144 selects the stored method as the one to use. 



35 
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The present invention has been described with reference to a 
limited number of exemplary image transmission, reconstruction and 
display methods. It is to be appreciated that the present 
invention applies to any situation where image material can be sent 
5 from a source to a receiver via a data transmission resource and 
can be reconstructed for display. 
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CLAIMS 

1. A method for sending a processed image, comprising one or 
more elements, from a server to a client for construction and 
display, said method comprising the steps of: determining the 
parameters for data transfer from the server to the client; 
determining the capabilities of the client; determining the task 
requirements; and apportioning the processing between the server 
and the client for each element to meet the task requirement. 

2. A method, according to claim 1, wherein said parameters for 
data transfer from said server to said client include one, all or 
some of: the transmission bandwidth of said server; the reception 
bandwidth of said client; the bandwidth of said data channel; the 
transmission protocol employed between said server and said client; 
and the accessibility of the channel employed between said server 
and said client. 

3. A method, according to claim 1 or claim 2, wherein said 
capabilities of said client include one, all or some of: the data 
processing speed of said client; the available memory of said 
client; the size of display in said client; and the data processing 
software available within said client. 

4. An method, according to any one of the preceding claims, 
wherein said task requirements comprise one, all or some of: the 
maximum time from transmission to display of the image; and the 
minimum display resolution of the image. 

5. A method, according to any one of the preceding claims, 
wherein each element can be constructed for display using a 
selectable one of a plurality of processing options, said method 
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including the step of selecting an option that meets the task 
requirements - 

6. A method, according to claim 5, wherein said step of 
selecting said processing option includes the step of measuring or 
calculating the time to execute of some or all of the plurality of 
options . 

7. A method, according to any one of the preceding claims, 
wherein said construction of an element can comprise one, all or 
some of: clothing a coarse mesh with a simple texture; clothing a 
fine mesh with a simple texture; clothing a coarse mesh with a 
complex texture; clothing a fine mesh with a complex texture; 
clothing a surface with a complex texture; clothing a surface with 
a simple texture; and clothing a surface with a three dimensional 
panel . 

8. A method, according to any one of the preceding claims, 
wherein said apportioning of the processing between said server and 
said client includes the step of allocating the location for each 
action in the construction of an element. 

9. A method, according to any one of the preceding claims, 
wherein said determining of said capabilities of said client 
includes the step of interrogation of said client by said server. 

10. A method, according to claim 9, wherein said interrogation of 
said client includes said client informing said server of said 
client' s abilities . 

11. A method, according to any one of the preceding claims, 
wherein said determining of said capabilities of said client can 
include reference, by said server, to a list of client 
characteristics for a plurality of different types of client. 



WO 03/061273 



PCT/GB03/00118 



19 

12. A method, according to any one of the preceding claims, 
wherein said meeting of task requirements includes: falling within 
the minimum time to execute; and being the fastest to execute. 

13. A method, according to any one of the preceding claims, 
wherein said server is a server in a mobile telephone system, and 
said client is a mobile telephone device. 

14. A system, operative to send a processed image, comprising 
one or more elements, said system comprising: a server, operative 
to send the image; a client, operative to receive, construct and 
display the image; parameter determination means, operative to 
determine the parameters for data transfer from said server to said 
client; capability determination means, operative to determine the 
capability of said client; task requirements determination means, 
operative to determine the task requirement; and processing 
apportioning means, operative to apportion the processing between 
said server and said client for each element to meet said task 
requirement . 

15. A system, according to claim 14, wherein said parameters 
for data transfer from said server to said client include one, all 
or some of: the transmission bandwidth of said server; the 
reception bandwidth of said client; the bandwidth of said data 
channel; the transmission protocol employed between said server and 
said client; and the accessibility of the channel employed between 
said server and said client. 

16. A system, according to claim 14 or claim 15, wherein said 
capabilities of said client include one, all or some of: the data 
processing speed of said client; the available memory of said 
client; the size of display in said client; and the data processing 
software available within said client. 
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17. A system, according to any one of claims 14 to 16, wherein 
said task requirements comprise one, all or some of: the maximum 
time from transmission to display of the image; and the minimum 
display resolution of the image. 

18. A system, according to any one of claims 14 to 18, wherein 
each element can be constructed for display using a selectable one 
of a plurality of processing options, said system including 
selection means, operative to select an option that meets the task 
requirements . 

19. A system, according to claim 18, wherein said selection 
means is operative to measure or calculate the time to execute of 
some or all of the plurality of options. 

20. A system, according to any one of claims 14 to 19, wherein 
said construction of an element comprises one, all or some of: 
clothing a coarse mesh with a simple texture; clothing a fine mesh 
with a simple texture; clothing a coarse mesh with a complex 
texture; clothing a fine mesh with a complex texture; clothing a 
surface with a complex texture; clothing a surface with a simple 
texture; and clothing a surface with a three dimensional panel. 

21. A system, according to any one of claims 14 to 20, wherein 
said process apportioning means includes means to allocate the 
location for each action in the construction of an element. 

22. A system, according to any one of claims 14 to 21, wherein 
said capability determination means is operative to interrogate 
said client from said server. 

23. A system, according to claim 22, wherein said interrogation 
of said client includes said client informing said server of said 
client' s abilities . 
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24. A system, according to any one of claims 14 to 23, wherein 
said capability determination means is operative to cause said 
server to reference a list of client characteristics for a 
plurality of different types of client. 

25. A system, according to any one of claims 14 to 24, wherein 
said meeting of task requirements includes: falling within the 
minimum time to execute; and being the fastest to execute. 

26. A system, according to any one of claims 14 to 25, wherein 
said server is a server in a mobile telephone system, and said 
client is a mobile telephone device. 

27. A server, operative to send a processed image, comprising 
one or more elements, to a client, operative to receive, construct 
and display the image said server comprising: parameter 
determination means, operative to determine the parameters for data 
transfer from said server to said client; capability determination 
means, operative to determine the capability of said client; task 
requirements determination means, operative to determine the task 
requirement; and processing apportioning means, operative to 
apportion the processing between said server and said client for 
each element to meet said task requirement. 

28. A server, according to claim 27, wherein said parameters 
for data transfer from said server to said client include one, all 
or some of: the transmission bandwidth of said server; the 
reception bandwidth of said client; the bandwidth of said data 
channel; the transmission protocol employed between said server and 
said client; and the accessibility of the channel employed between 
said server and said client. 

29. A server, according to claim 27 or claim 28, wherein said 
capabilities of said client include one, all or some of: the data 
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processing speed of said client; the available memory of said 
client; the size of display in said client; and the data processing 
software available within said client. 

30. A server, according to any one of claims 27 to 29, wherein 
said task requirements comprise one, all or some of: the maximum 
time from transmission to display of the image; and the minimum 
display resolution of the image. 

31. A server, according to any one of claims 27 to 30, wherein 
each element can be constructed for display using a selectable one 
of a plurality of processing options, said server comprising 
including selection means, operative to select an option that 
meets the task requirements. 

32. A server, according to claim 31, wherein said selection 
means is operative to measure or calculate the time to execute of 
some or all of the plurality of options. 

33. A server, according to any one of claims 27 to 32, for use 
where said construction of an element comprises one, all or some 
of: clothing a coarse mesh with a simple texture; clothing a fine 
mesh with a simple texture; clothing a coarse mesh with a complex 
texture; clothing a fine mesh with a complex texture; clothing a 
surface with a complex texture; clothing a surface with a simple 
texture; and clothing a surface with a three dimensional panel. 

34. A server, according to any one of claims 27 to 33, wherein 
said process apportioning means includes means to allocate the 
location for each action in the construction of an element. 

35. A server, according to any one of claims 27 to 34, wherein 
said capability determination means is operative to interrogate 
said client from said server. 
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36. A server, according to claim 35, wherein said interrogation 
of said client includes said client informing said server of said 
client' s abilities . 

37. A server, according to any one of claims 27 to 36, wherein 
said capability determination means is operative to cause said 
server to reference a list of client characteristics for a 
plurality of different types of client. 

38. A server, according to any one of claims 27 to 37, wherein 
said meeting of task requirements includes: falling within the 
minimum time to execute; and being the fastest to execute. 

39. A server, according to any one of claims 27 to 38, wherein 
said server is a server in a mobile telephone system, and said 
client is a mobile telephone device. 

40. A client, operative to receive, construct and display a 
processed image, comprising one or more elements, sent from a 
server, said client comprising; means to co-operate with parameter 
determination means, operative to determine the parameters for data 
transfer from said server to said client; means to co-operate with 
capability determination means, operative to determine the 
capability of said client; means to co-operate with task 
requirements determination means, operative to determine the task 
requirement; and means to co-operate with processing apportioning 
means, operative to apportion the processing between said server 
and said client for each element to meet said task requirement. 

41. A client, according to claim 40, wherein said parameters 
for data transfer from said server to said client include one, all 
or some of: the transmission bandwidth of said server; the 
reception bandwidth of said client; the bandwidth of said data 
channel; the transmission protocol employed between said server and 
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said client; and the accessibility of the channel employed between 
said server and said client. 

42. A client, according to claim 40 or claim 41, wherein said 
capabilities of said client include one, all or some of: the data 
processing speed of said client; the available memory of said 
client; the size of display in said client; and the data processing 
software available within said client. 

43. A client, according to any one of claims 40 to 42, wherein 
said task requirements comprise one, all or some of: the maximum 
time from transmission to display of the image; and the minimum 
display resolution of the image. 

44. A client, according to any one of claims 40 to 43, wherein 
each element can be constructed for display using a selectable one 
of a plurality of processing options, said client being co- 
operative with selection means, operative to select an option that 
meets the task requirements. 

45. A client, according to any one of claims 40 to 44, for use 
where said construction of an element comprises one, all or some 
of: clothing a coarse mesh with a simple texture; clothing a fine 
mesh with a simple texture; clothing a coarse mesh with a complex 
texture; clothing a fine mesh with a complex texture; clothing a 
surface with a complex texture; clothing a surface with a simple 
texture; and clothing a surface with a three dimensional panel. 

46. A client, according to any one of claims 40 to 45, wherein 
said process apportioning means includes means to allocate the 
location for each action in the construction of an element. 
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47. A client, according to any one of claims 40 to 46, wherein 
said capability determination means is operative to interrogate 
said client from said server. 

48. A client, according to claim 47, wherein said interrogation 
of said client includes said client informing said server of said 
client' s abilities . 

49. A client, according to any one of claims 40 to 47, wherein 
said capability determination means is operative to cause said 
server to reference a list of client characteristics for a 
plurality of different types of client. 

50. A client, according to any one of claims 40 to 49, wherein 
said meeting of task requirements includes: falling within the 
minimum time to execute; and being the fastest to execute. 

51. A client, according to any one of claims 27 to 38, wherein 
said server is a server in a mobile telephone system, and said 
client is a mobile telephone device. 



WO 03/061273 



1/7 



PCT/GB03/00118 




FIGURE 1 



WO 03/061273 



2/7 



PCT/GB03/00118 




WO 03/061273 



PCT/GB03/00118 



3/7 



00 
CO 





1 

> J M III 


u 




J 


if 







T 

CO 



CO 
LU 
DC 




ooooooo 
ooooooo 
ooooooo 
ooooooo 
ooooooo 
ooooooo 
ooooooo 
ooooooo 
ooooooo 
ooooooo 
ooooooo 




WO 03/061273 



4/7 



PCT/GB03/00118 



50 




X X X X X X 
X X X X X X 
X X X X X X 



FIGURE 4B 



WO 03/061273 



PCT/GB03/00118 



5/7 




76 



CONSULT 
ELEMENT 
MEMORY 



ANALYSE SCENE 
INTO ELEMENTS 
AND STORE IN 
ELEMENT MEMORY 



I 



74 



GET FIRST 
ELEMENT FROM 
ELEMENT 
MEMORY 



I 



94 



EXIT 



78 



GET RECEIVER 
PARAMETERS 



I 



I 



STORE 
FASTEST 
ROUTINE 
LIST 



96 



FIND FASTEST 
WAY TO GET 
ELEMENT INTO 
RECEIVER 



I 



80 




CREATE 

FASTEST 

ROUTINE 



I 



82 



SEND FASTEST 
ROUTINES 
TO 

RECEIVER 



FIGURE 5 



ADD TO 
FASTEST 
ROUTINE 
LIST 




88 



GET NEXT 
ELEMENT FROM 
ELEMENT 
MEMORY 



WO 03/061273 



6/7 



PCT/GB03/00118 




102 



GET 

PARAMETERS 
FROM TYPE 
MEMORY 



GET PROCESS 
SPEED 



1 



GET MEMORY 
CAPACITY 



I 



112 



GET TYPES 
OF ROGRAM 



I 



114 



IDENTIFIER —116 



I 



SAVE IN 

PARAMETER 

MEMORY 



118 



104 



EXIT 



FIGURE 6 



ENTER 



120 



122 



T 



GET 

RESOURCES 
FROM STORE 



124 



I 



GET TASK 
REQUIREMENTS 



126 

128 

— ► 



i 



CREAT FIRST 
SET OF 
POSSIBLE 
RESOURCES 



GET NEXT SET OF 

POSSIBLE 

RESOURCES 



TEST TIME TO 
EXECUTE ON 
RECEIVER 
PARAMETERS 




USE THIS 
METHOD 



134 




I 



EXIT 



FIGURE 7 



WO 03/061273 



7/7 



PCT/GB03/00118 



C 



ENTER 




GET 

RESOURCES 
FROM STORE 



i 



GET TASK 
REQUIREMENTS 



I 



124 



CREAT FIRST 
SET OF 
POSSIBLE 
RESOURCES 



GET NEXT SET OF 
POSSIBLE 
RESOURCES 



126 



TEST TIME TO 
EXECUTE ON 
RECEIVER 
PARAMETERS 



128 




STORE 

METHOD 

AND 

VALUE 



YES 



142 




USE STORED 
METHOD 



FIGURE 8 



INTERNATIONAL SEARCH REPORT 



Internal Application No 

PCT/t.B 03/00118 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 H04N1/333 H04N1/00 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 G06F H04N 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 

EPO-Internal , PAJ, WPI Data 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 0 Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5 684 604 A (SHOJI FUMIO ET AL) 

4 November 1997 (1997-11-04) 

column 3, line 60 -column 11, line 47 

EP 0 652 668 A (MICROSOFT CORP) 
10 May 1995 (1995-05-10) 
the whole document 

W0 01 93562 A (BANDAI CO ; ISHII FUJIO 

(JP); T0BITA NAOMI (JP)) 

6 December 2001 (2001-12-06) 

abstract 

EP 1 058 419 A (CANON EUR0PA NV) 
6 December 2000 (2000-12-06) 
abstract 

-/— 



1,14,27, 
40 



1,14,27, 
40 



1-51 



1-51 



m 



Further documents are listed in Ihe continuation of box C. 



Patent family members are listed in annex. 



0 Special categories of cited documents : 

'A' document defining Ihe general state of the art which is not 

considered to be of particular relevance 
"E" earlier document but published on or after the international 

filing date 

'L* document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

■P" document published prior to the international filing date but 
later than the priority date claimed 



■T later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

'X' document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date of Ihe actual completion of the international search 



4 April 2003 



Date of mailing of the international search report 



14/04/2003 



Name and mailing address of the ISA 

European Patenl Office, P.B. 5818 Patentlaan 2 
NL - 2280 HV Rijswijk 
Tel. (+31-70) 340-2040, Tx. 31 651 epo nl, 
Fax: (+31-70) 340-3016 



Authorized officer 



Waern, G 



Form PCT/ISA/210 (second sheet) (July 1992) 



INTERNATIONAL SEARCH REPORT 



Intemat Application No 

PCT/fcb 03/00118 



C(Contlnuation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with indication.where appropriate, of the relevant passages 



Relevant to claim No. 



US 2001/034783 Al (KITAMURA YOSHIMASA) 
25 October 2001 (2001-10-25) 
page 2, paragraphs 28-39 

US 5 805 301 A (RASANEN) 

8 September 1998 (1998-09-08) 

abstract 



1-51 



1-51 



Form PCT/ISA/210 (continuation of second sheet) (July 1992) 



INTERNATIONAL SEARCH REPORT 

ation on patent family members 



Internatl Application No 

PCT/bu 03/00118 



Patent document 




Publication 




Patent family 




Publication 


cited in search report 




date 




member(s) 




date 


Uo D0040U4 


A 

A 


(\A 11 1 QQ7 

iw— i i— xyy / 


IP 


^1 9&AQA 
Jl C.OHOH 


DO 


cc— Ul— £UU1 








JP 


5308527 


A 


19-11-1993 








JP 


5344344 


A 


24-12-1993 








ID 

Jr 


jjUoDUU 


DO 

D£ 










IP 


0U:7O±*fO 


A 




EP 0652668 


A 


10-05-1995 


CA 


2134620 


Al 


06-05-1995 








EP 


0652668 


A2 


10-05-1995 








JP 


7203177 


A 


04-08-1995 








US 


5621894 


A 


15-04-1997 


WO 0193562 


A 


06-12-2001 


WO 


0193562 


Al 


06-12-2001 








AU 


4783300 


A 


11-12-2001 








EP 


1292094 


Al 


12-03-2003 



EP 


1058419 


A 


06- 


-12- 


-2000 


FR 


2794320 


Al 


01-12-2000 














FR 


2794321 


Al 


01-12-2000 














FR 


2794326 


Al 


01-12-2000 














EP 


1058419 


A2 


06-12-2000 


US 


2001034783 


Al 


25- 


-10- 


-2001 


JP 


2001306467 


A 


02-11-2001 














FI 


20010796 


A 


20-10-2001 


US 


5805301 


A 


08- 


-09- 


-1998 


FI 


951020 


A 


07-09-1996 














AT 


205033 


T 


15-09-2001 














AU 


702866 


B2 


11-03-1999 














AU 


4833496 


A 


23-09-1996 














CA 


2188788 


Al 


12-09-1996 














CN 


1168211 


A ,B 


17-12-1997 














DE 


69614791 


Dl 


04-10-2001 














DE 


69614791 


T2 


23-05-2002 














DK 


759247 


T3 


08-10-2001 














EP 


0759247 


Al 


26-02-1997 














ES 


2160802 


T3 


16-11-2001 














WO 


9627975 


Al 


12-09-1996 














HK 


1000062 


Al 


03-05-2002 














JP 


10500275 


T 


06-01-1998 














NO 


964687 


A 


05-11-1996 



Form PCT/ISA/210 (patent family annex) (July 1992) 



